On gradient adaptation with unit-norm constraints

نویسندگان

  • Scott C. Douglas
  • Shun-ichi Amari
  • Sun-Yuan Kung
چکیده

{ In this correspondence, we describe gradient-based adaptive algorithms within parameter spaces that are speciied by jjwjj = 1, where jj jj is any vector norm. We provide several algorithm forms and relate them to true gradient procedures via their geometric structures. We also give algorithms that mitigate an inherent numerical instability for L 2-norm-constrained optimization tasks. Simulations showing the performance of the techniques for independent component analysis are provided. 0 Permission of the IEEE to publish this abstract separately is granted.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Dual Modifier-Adaptation Approach for Real-Time Optimization

For good performance in practice, real-time optimization schemes need to be able to deal with the inevitable plant-model mismatch problem. Unlike the two-step schemes combining parameter estimation and optimization, the modifier-adaptation approach does not require the model parameters to be estimated on-line. Instead, it uses information regarding the constraints and selected gradients to impr...

متن کامل

Gradient descent of the frame potential

Unit norm tight frames provide Parseval-like decompositions of vectors in terms of possibly nonorthogonal collections of unit norm vectors. One way to prove the existence of unit norm tight frames is to characterize them as the minimizers of a particular energy functional, dubbed the frame potential. We consider this minimization problem from a numerical perspective. In particular, we discuss h...

متن کامل

Simple Construction of a Frame which is $epsilon$-nearly Parseval and $epsilon$-nearly Unit Norm

In this paper, we will provide a simple method for starting with a given finite frame for an $n$-dimensional Hilbert space $mathcal{H}_n$ with nonzero elements and producing a frame which is $epsilon$-nearly Parseval and $epsilon$-nearly unit norm. Also, the concept of the $epsilon$-nearly equal frame operators for two given frames is presented. Moreover, we characterize all bounded invertible ...

متن کامل

Two Equivalent Presentations for the Norm of Weighted Spaces of Holomorphic Functions on the Upper Half-plane

Introduction In this paper, we intend to show that without any certain growth condition on the weight function, we always able to present a weighted sup-norm on the upper half plane in terms of weighted sup-norm on the unit disc and supremum of holomorphic functions on the certain lines in the upper half plane. Material and methods We use a certain transform between the unit dick and the uppe...

متن کامل

Gradient Flow of the Norm Squared of a Moment Map

We present a proof due to Duistermaat that the gradient flow of the norm squared of the moment map defines a deformation retract of the appropriate piece of the manifold onto the zero level set of the moment map. Duistermaat’s proof is an adaptation of Lojasiewicz’s argument for analytic functions to functions which are locally analytic.

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • IEEE Trans. Signal Processing

دوره 48  شماره 

صفحات  -

تاریخ انتشار 2000